![]() METHOD AND CALCULATOR FOR OBTAINING LABEL POSITIONS
专利摘要:
A method of obtaining label positions in an image controller includes: receiving (i) a definition of a plane that includes edges of a support structure, and (ii) a plurality of initial label indicators that have locations on the plane; designating the initial label indicators from a plurality of candidate sub-sets of label indicators, each candidate sub-set representing a single physical label; for each candidate subset of initial label indicators: generating, for each of a plurality of projection depths relative to the plane, a set of projections of the initial label indicators in the candidate subset; determining a composite surface area for each set of projections; selecting, as an obtained depth for the candidate subset, one of the projection depths corresponding to the minimum composite surface area; and generating an obtained position for the candidate subset based on the obtained depth; and storing the obtained positions. 公开号:BE1026160B1 申请号:E20195215 申请日:2019-04-03 公开日:2020-07-15 发明作者:Joseph Lam;Vlad Gorodetsky;Richard Jeffrey Rzeszutek 申请人:Symbol Technologies Llc; IPC主号:
专利说明:
METHOD AND CALCULATOR FOR OBTAINING LABEL POSITIONS Background Environments that manage inventory of objects, such as products for purchase in a retail environment, can be complex and changeable. For example, a given environment can include a wide variety of objects with different attributes (size, shape, price and the like). Furthermore, the placement and quantity of the objects in the environment can change frequently. In addition, imaging conditions such as lighting may vary over time and at different locations in the environment. These factors may reduce the accuracy with which information about the objects can be collected within the environment. Certain objects, such as labels, can be especially difficult to detect accurately due to their small size and placement on or near other structures such as shelf edges. Summary In accordance with an aspect of the invention, a method of obtaining label positions in an image controller is provided, the method comprising: receiving (1) a definition of a plane comprising edges of a support structure, and (ii) a plurality of initial label indicators that have locations on the plane; assigning the initial label indicators to candidate subsets from a plurality of candidate subsets of label indicators, each candidate subset representing a single physical label; for each candidate subset of initial label indicators: generating, for each of a plurality of projection depths relative to the plane, a set of projections of the initial label indicators in the candidate subset; selecting, as an acquired depth for the candidate subset, one of the projection depths based on the sets of projections; and generating an acquired position for the candidate subset based on the acquired depth; and storing the obtained positions. Advantageously, each initial label indicator includes decoded data; and wherein assigning the initial label indicators to candidate subsets from a plurality of candidate subsets comprises assigning each initial label indicator to one of the candidate subsets based on the decoded data. Furthermore, the method may include receiving an edge indicator that defines a location of an edge of the support structure in the plane; wherein assigning the initial label indicators to candidate subsets from a plurality of candidate subsets further comprises: for initial label indicators that do not overlap with the edge indicator, assigning each initial label indicator to one of the candidate subsets based on the decoded data. Advantageously, the edge indicator is a shelf edge indicator. Alternatively and / or additionally, assigning the initial label indicators to candidate subsets from a plurality of candidate subsets further, for initial label indicators overlapping with the boundary indicator, assigning the initial label indicators to one of a plurality of sets based on the decoded data; determining an average position of the initial label indicators within each set; and assigning the initial label indicators within each set to the candidate subsets based on a distance from each of the initial label indicators to the average position. The method may further include: determining a composite surface area for each set of projections; and selecting, as the obtained depth, the projection depth corresponding to a minimum composite surface area. Also, prior to generating the sets of projections, the method may further include, for each of a plurality of coarse projection depths relative to the plane, generating a set of coarse projections of the initial label indicators in the candidate subset; selecting one of the coarse projection depths; and generating the plurality of projection depths based on the selected coarse projection depth. Advantageously, generating the multiple number of projection depths includes adding a predetermined increase to the selected coarse projection depth. The support structure can be, for example, a shelf or a table. According to another aspect of the invention, a calculator for obtaining label positions is provided, the calculator comprising: a memory; and an array controller connected to the memory, the image controller adapted to: (U) receive a definition of a plane comprising edges of a support structure, and (ii) receive a plurality of initial label indicators having locations on the plane; assign the initial label indicators to candidate subsets from a plurality of candidate subsets of label indicators, each candidate subset representing a single physical label; for each candidate subset of initial label indicators: for each of a plurality of projection depths relative to the plane, generate a set of projections of the initial label indicators in the candidate subset; as an acquired depth for the candidate subset, select one of the projection depths based on the sets of projections; and generate an acquired position for the candidate subset based on the acquisition depth; and the image controller is further arranged to store the obtained positions in the memory. In a further aspect of the calculator, each initial label indicator may include decoded data; and the image controller may further be arranged to assign the mitial label indicators to candidate subsets from a plurality of candidate subsets by assigning each initial label indicator to one of the candidate subsets based on the decoded data. Advantageously, the image controller may further be arranged to: receive an edge indicator that defines an edge location of the support structure in the plane; assigning the initial label indicators to candidate subsets from a plurality of candidate subsets further by: for initial label indicators that do not overlap with the edge indicator, assigning each initial label indicator to one of the candidate subsets based on the decoded data. For example, the edge indicator can be a shelf edge indicator. The image controller may further be arranged to assign the intimate label indicators to candidate subsets from a plurality of candidate subsets by, for initial label indicators overlapping the edge indicator: assign the initial label indicators to a multiple number set based on the decoded data; determining an average position of the initial label indicators within each set; and assigning the initial label indicators within each set to the candidate subset based on a distance from each of the initial label indicators to the average position. The image controller may further be arranged to: determine a composite surface area for each set of projections; and as the depth obtained, selecting the projection depth corresponding to a minimum composite surface area, alternatively and / or additionally, the image controller is further arranged, prior to generating the sets of projections: for each of a plurality of coarse projection depths relative to from the plane, generate a set of coarse projections of the initial label indicators in the candidate subset; select one of the coarse projection depths; and wherein the image controller is further arranged to generate the multiple number of projection depths based on the selected coarse projection depth. For example, the image controller may be further arranged to generate the multiple number of projection depths by adding a predetermined increase to the selected coarse projection depth. BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS The accompanying figures, where like reference numerals refer to identical or functionally similar elements in the individual views, along with the figure description below, are incorporated herein and form part of the description and serve to illustrate embodiments of concepts. comprising the claimed invention to further illustrate and explain several principles and advantages of these embodiments. Herein shows: FIG. 1 a sketch of a mobile automation system; FIG. ZA is a mobile automation device in the system of FIG. 1; FIG. 25 is a block diagram of certain internal hardware components of the mobile automation device in the system of FIG. 1: FIG. 3 is a block diagram of certain internal components of the server of FIG. I: FIG. 4 is a flowchart of a method of obtaining label positions; FIG. 5A an example shelf arrangement; FIG. 5B recorded data and initial label indicators corresponding to the shelf of FIG. 54; FIG. 6 the initial label indicators of FIG. 5B in more detail; FIG. 7 is a flowchart of a method of assigning the label indicators to candidate subsets; FIGs SA and 8B an exemplary embodiment of the method of FIG. 7: FIGs SA through 9D an exemplary embodiment of block 420 of the method of FIG. 4: FIG, 10 is a flowchart of a method of refining projection depth for use in the method of FIG. 4, and FIG. 11A and 11B respectively enter example and results of the performance of the method of FIG. 4. Elements in the figures are shown for simplicity and clarity and are not necessarily drawn to scale. For example, the dimensions of some of the elements in the figures may be exaggerated relative to other elements to help improve understanding of embodiments of the present invention. The device and method components are represented, where appropriate, by conventional symbols in the figures, showing only those specific details that are relevant to understanding the embodiments of the present invention, otherwise obscuring the description with details that are readily apparent per se. Detailed Description Examples described herein are directed to a method of obtaining label positions in an image controller, the method comprising: receiving (1) a definition of a plane comprising edges of a support structure, and (ii) a multiple number of initial label indicators that have locations on the plane; designating the imaginary label indicators from a plurality of candidate sub-sets of label indicators, each candidate sub-set representing a single physical label; for each candidate subset of imitative label indicators: generating, for each of a plurality of projection depths relative to the plane, a set of projections of the initial label indicators in the candidate subset; selecting, as an acquired depth for the candidate subset, one of the projection depths based on the sets of projections; and generating an obtained position for the candidate subset based on the obtained depth; and storing the obtained positions. Additional examples described herein are directed to a calculator for obtaining label positions, comprising: a memory; and an image controller connected to the memory, the image controller adapted to: (1) receive a definition of a plane comprising edges of a support structure, and (11} a plurality of initial label indicators having locations on the plane; designate the initial label indicators from a plurality of candidate sub-sets of label indicators, each candidate subset representing a single physical label; for each candidate subset of initial label indicators: for each of a plurality of projection depths relative to the plane, a set of projections of the initial label indicators in the candidate subset; as an acquired depth for the candidate subset, select one of the projection depths based on the sets of projections; and generate an acquired position for the candidate subset based on the obtaining depth, and the be The controller is further arranged to store the obtained positions in the memory. FIG. 1 shows a mobile automation system 100 in accordance with the teachings of this description. The system 100 includes a server 101 in communication with at least one mobile automation device 103 (also referred to herein simply as the device 103) and with at least one client computing device 105 over communication links 107, which in the present example are illustrated as including wireless connections. In the present example, connections 107 are provided by a wireless local area network (WLAN) deployed in the retail environment through one or more access points (not shown). In other examples, the server 101, the client device 105, or both are located outside of retail. environment, and connections 107 therefore include wide-area networks such as the Internet, mobile networks and the like. The system 100 also includes a dock 108 for the device 103 in the present example. The dock 108 is connected to the server 101 via a connection 109 which is a wired connection in the present example. However, in other examples, the connection 109 is a wireless connection. The client calculator 105 is shown in FIG. 1 as a mobile calculator, such as a tablet, smartphone or the like. In other examples, the client device 105 is implemented as another type of computing device, such as a desktop computer, a laptop computer, another server, a kiosk, a monitor, and the like. The system 100 may include a plurality of client devices 105 in connection with the server 101 via connections 107. The system 100 is deployed in the illustrated example in a retail environment comprising a plurality of shelf modules 110-1, 110-2, 110-3 and so on (collectively referred to as shelves 110, and generally referred to as as a shelf 110 - this naming is also used for other elements discussed herein). Each shelf module 110 supports a plurality of products 112. Each shelf module 110 includes a shelf backside 116-1, 116-2, 116-3 and a support surface (e.g., support surface 117-3 as shown in FIG. 1) that extends from the plank back 116 to a plank edge 118-3, 118-2, 118-3. In other examples, the environment may include additional support structures (e.g., tables, pin boards, etc.) adjacent to or in place of the shelf modules 110. The shelf modules 110 are typically arranged in a multiple number of paths, each of which includes a multiple number of modules 110 aligned from end to end. In such arrangements, the shelf edges 118 face the paths, allowing customers in the retail environment as well as the device 103 to move. As will be apparent from FIG. 1, the term "shelf edge" 118 as used herein, which may also be referred to as the edge of a support surface (e.g., the support surfaces 117), refers to a surface bounded by adjacent surfaces with different angles of inclination. In the example shown in FIG. 1, the shelf edge 118-3 is angled approximately ninety degrees from each of the support surface 117-3 and the bottom (not shown) of the support surface 117-3. In other examples, the angles between the shelf edge 118-3 and the adjacent surfaces, such as the support surface 117-3, are more or less than ninety degrees. The direction 103 is deployed in the retail environment and communicates with the server 101 (e.g., through the connection 107 ) to navigate autonomously or partially autonomously along a length 119 of at least a portion of the shelves 110. The device 103 is arranged to perform such navigation relative to a frame 102 set within the retail environment. The device 103 is equipped with a plurality of navigation and data recording sensors 104, such as image sensors (e.g., one or more digital cameras) and depth sensors (e.g., one or more Light Detection and Range (LIDAR) sensors, one or more depth cameras that have structured light patterns such as infrared light, and the like}, and 1s further arranged to use the sensors 104 to record shelf data In the present example, the device 103 is arranged to record image data and depth measurements (defining a distance from a depth sensor on the device 103 to a point on the shelf 110, such as a product 112, a shelf backside 116 or the like) corresponding to the shelves 110. The server 101 includes a special-purpose image controller (special purpose imaging controller), such as a processor 120, which is specifically designed to control the mobile automation device 103 to record data (e.g., the aforementioned images and depth measurements). The processor 120 is further arranged to obtain the recorded data via a communication interface 124 and to store the recorded data in a memory module 132 in a memory 122 connected to the processor 120. The server 101 is further arranged for various post processing perform operations on the recorded data, which may include reporting the recorded data to frame 102 based on stored data representing positions of the device 103 indicate the time of recording as well as calibration data defining relationships between image and depth sensors on the device 103. The process of reporting the recorded data to the frame of reference is referred to herein as back-projecting. As will be described in more detail below, the post-processing functions performed by the server 101 include recovering positional data corresponding to labels placed on the shelves 110 from the recorded data. The server 101 may also be configured to determine product status data (for example, to detect spaces on shelves 110}, and to send status notifications (for example, notifications that indicate that products are out of stock, low on stock, or incorrect). the client device 105 in response to the determination of product status data. The client device 105 includes one or more controllers (e.g., central processing units (CPUs) and / or field-programmable gate arrays (FPGAs) and the like) which are arranged to process notifications ( for example to show) received from the server 101. The processor 120 is interconnected to a non-perishable computer readable storage medium, such as the aforementioned memory 122, having stored thereon computer readable instructions for performing operation of the device 103 to record data as well as the aforementioned post-processing functionality, which is discussed in more detail below. Memory 122 includes a combination of volatile (e.g., Random Access Memory or RAM) and non-volatile memory (e.g., read only memory or ROM, Eletrically Erasable PRogrammable Read Only Memory or EEPROM, flash memory). The processor 120 and the memory 122 each comprise one or more integrated circuits. In some embodiments, the processor 120 is implemented as one or more central processing units (CPUs) and / or graphics processing units (GPUs). The server 101 also includes the above-mentioned communication interface 124 which is interconnected with the processor 120. The communication interface 124 includes suitable hardware (e.g. transmitters, receivers, network interface controllers and the like) that allow the server 101 to communicate with other computing devices - in particular, device 103, client device 105, and dock 108 - through connections 107 and 109. Connections 107 and 109 may be direct connections or connections that cross one or more networks, including both local and wide area networks are included. The specific components of the communication interface 124 are selected based on the type of network or other connections over which the server 101 is to communicate. In the present example, as noted previously, a wireless local area network has been implemented in the retail environment by deploying one or more wireless access points. The connections 107 therefore include wireless connections between the device 103 and the mobile device 105 and the aforementioned access points, and a wired connection (e.g. an Ethernet-based connection) between the server 101 and the access point. Memory 122 stores a plurality of applications, each of which includes a plurality of computer-readable instructions that can be executed by processor 120. The execution of the aforementioned instructions by the processor 120 directs the server 101 to perform various operations discussed herein, including the aforementioned obtaining of label positions. The applications stored in memory 122 include a control application 128, which can also be implemented as a set (suite) of logically different applications. Generally, the processor 120 is arranged, through execution of the control application 128 or sub-components thereof, and in conjunction with the other components of the server. 101, implement various functionalities. The processor 120, as configured through the implementation of the control application 128, is also referred to herein as the controller 120. As will now be understood, some or all of the functionality implemented by the controller 120, described below, may also are executed by pre-provisioned hardware elements (for example one or more FPGAs and / or application specific integrated circuits (ASICs}}) instead of execution of the control application 128 by the processor 120. Referring to FIGS. ZA and 2B, the mobile automation device 103 is now shown in more detail. The device 103 comprises a chassis 201 comprising a moving mechanism 203 (for example, one or more electric motors driving the wheels, tracks or the like). The device 103 further comprises a sensor mast 205 supported on the chassis 201 and in the present example extends upward (e.g. substantially vertically} from the cha ssis 201. The mast 205 supports the sensors 104 mentioned previously. In particular, the sensors 104 include at least one image sensor 207, such as a digital camera, as well as at least one depth sensor 209, such as a 3D digital camera. The device 103 also includes additional depth sensors, such as LIDAR sensors 211. In other examples, the device 103 additional sensors, such as one or more RFID readers, temperature sensors, and the like. In the present example, the mast 205 supports seven digital cameras 207-1 through 207-7 and two LIDAR sensors 211-1 and 35 211-2. The mast 205 also supports a plurality of illumination assemblies 213 arranged to illuminate the fields of view of the cameras 207. That is, the lighting assembly 213-1 illuminates the field of view of the camera 207-1, and so on. The sensors 207 and 211 are oriented on the mast 205 such that the fields of view of each sensor face a shelf 110 along the length 119 along which the device 103 moves. The device 103 is arranged to track a location of the device 103 (e.g., a location of the center of the chassis 201), for example, in the frame 102 previously set in the retail facility, allowing data to be recorded is reported by the mobile automation device to frame 102. The mobile automation device 103 includes a special-purpose controller 220, such as a processor 220, as shown in FIG. 2B, which is interconnected with a non-perishable computer-readable storage medium, such as a memory 222. Memory 222 comprises a combination of volatile (for example, Random Access Memory or RAM) and non-volatile memory (for example, read only memory or ROM , Eletrically Erasable PRogrammable Read Only Memory or EEPROM, flash memory). The processor 220 and the memory 222 each comprise one or more integrated circuits. The memory 222 stores computer-readable instructions for execution by the processor 220. In particular, the memory 222 stores a control application 228 which, when executed by the processor 220, the processor 220 arranges to perform various functions related to the navigation of the device 103 (e.g., by controlling the moving mechanism 203) and collecting data (e.g., image and / or depth measurements) that the planks 110, The application 228 can also be implemented as a set of different applications in other examples. The processor 220, when so arranged by the implementation of the application 228, can also be referred to as a controller 220. The functionality implemented by the processor 220 through the implementation of the application 288 may also be implemented by one or more specially designed hardware or firmware components, such as FPGAs, ASICs and the like in other embodiments. The memory 222 may also store a memory module 232 which includes, for example, a map of the environment in which the device 103 functions, for use during the execution of the application 228. The device 103 may further communicate with the server 101, for example to receive instructions to initiate data recording operations through a communication interface 224 through connection 107 shown in FIG. 1. The communication interface 224 also allows the device 103 to communicate with the server 101 through the dock 108 and the connection 109. In the present example, as described below, the server 101 (as configured through the implementation of the control application 128 by the processor 120) and / or the mobile automation device 103 (as arranged through the execution of the application 228 by the processor 220) arranged to process image and depth data recorded by the device 103 to obtain label positions (e.g. in the frame of reference 102) from the recorded data. The label positions can be stored for use in downstream processing, such as price verification, product status detection (for example, to detect a product 112 that does not match a nearby label) and the like. In further examples, the data processing discussed below can be performed on a computing device other than the server 101 and the mobile automation device 103, such as the screening device 105. The aforementioned data processing will be described in more detail in relation to its execution at the server 101, through execution of the application 128, With respect to FIG. 3, before describing the operation of the application 128 to correct translucency artifacts in depth data recorded by the device 103, certain components of the application 128 are described in more detail. As will be apparent to those skilled in the art, in other examples, the components of the application 128 may be separated into different applications, or combined into other sets of components. Some or all of the components shown in FIG, 3 may also be implemented as specific hardware components, such as one or more ASICS or FPGAs. The control application 128 includes a candidate subset generator 300 that is arranged to obtain input data that includes initial label indicators, The initial label indicators indicate the positions of labels in the reference frame 102, but may also be affected by various error sources, Furthermore, any physical label may be shelves 110 are shown by more than one initial label indicator, for recording in successive frames of image and depth data. The candidate subset generator 300 is arranged to assign the initial label indicators to candidate subset each representing a single physical label on the shelves 110. The control application also includes a depth optimizer 304 which is directed to select an acquired depth for each of the candidate subsets of initial label indicators. The depth obtained strives to curb or eliminate some of the above error sources and thus represents a more accurate depth for the underlying physical label than that defined by the initial label indicators. The control application 128 also includes a position generator 308, which is arranged to generate acquired positions for each of the candidate subsets of initial label indicators. The acquired positions can be stored in the memory module 132 for further processing. For example, the obtained positions can be provided to a further application at the server 101 to assess planogram fulfillment (e.g., whether the labels are in positions conforming to a planogram stored in the memory module 132). The functionality of the control application 128 will now be described in more detail. With regard to FIG. 4, a method 400 for obtaining label positions in recorded data showing the shelves 110 is shown. The method 400 will be described along with its implementation on the system 110, and specifically with reference to the components of the server 101 shown in FIG. 3. At block 405, the server 101, and in particular the candidate subset generator 300 of the application 128 (as executed by the processor 120) is arranged to obtain the input data used in the execution of the method 400 to determine the obtained label positions. to generate. The input data includes a representation of a plank plane. The plank plane is a plane that includes plank edges (for example, the edges 118 shown in FIG. 1) and can be generated by a plank face generator that is performed by the processor 120 itself or by another calculator. An exemplary plank surface detector can be arranged to process depth measurements from the modules 110 or 510 (e.g., taken up by the device 103 with the depth sensor 209) to select a subset of the depth measurements indicative of plank edges (e.g. indicative of mainly vertical surfaces), and to fit a plank surface to the selected depth measurements. The plane definition obtained at block 405 may include an equation, a set of vectors or the like defining the plane, for example, according to the frame of reference 102. The server 101 is also arranged to obtain at block 405 a plurality of initial label indicators indicating the position of labels detected in the recorded data by the device, showing the shelves 110. Each initial label indicator includes at least one location (for example, in the frame 102). Each initial label indicator may also include data that has been decoded or otherwise obtained from the label, such as a strand decoded from a barcode printed on the corresponding label, a recognized price (e.g., through optical character recognition, OCR) from the label, and the like. The initial label indicators may have been previously generated through the execution of a label detector by the server 101 or other computing device. An example label detector may be arranged to process images from the modules 110 or 510 (e.g., captured by the device 103 with the cameras 207) to generate a property mask indicating the locations in the images that include certain predefined properties (e.g., barcodes, blocks text and the like). The label detector can then be arranged to identify locations within the property mask that correspond to predefined label templates, which indicate the likely presence of a label. Label indicators can then be generated from the above locations, for example, as bounding boxes. As will be seen in more detail below, at block 405, the server 101 may also be arranged to obtain data indicating the locations of plank edges (e.g., edges 118). The shelf edge locations are obtained in the present example as bounding boxes {defined, for example, by coordinates in the frame of reference 102 and falling within the above plane). The shelf edge locations may have been previously generated through the execution of a shelf structure detector by the server 101 or other computing device. An exemplary shelf edge detector can process, for example, images from the modules 110 or 510 (captured by the device 103 with the cameras 207, for example) to identify intensity transitions (transitions from light to dark and from dark to light) indicative of plank edges indicative of shelf boards. The shelf edge detector can produce bounding boxes corresponding to the areas (i.e. the likely shelf edges) bounded by such transitions, As noted above, example processes for the generation of the above data are set forth in corresponding applications from the applicant, and are therefore not discussed in detail herein. In the present example embodiment of the method 400, the server 101 executes block 405 by obtaining the shelf plane, imitation label indicators and optionally the shelf edge indicators, from the memory module 132, the input data previously stored in the memory module following upstream processing of data recorded by the device 103. Although the generation of the above input data is discussed in detail, a brief summary of exemplary mechanisms for generation of the input data from data recorded by the device 103 is provided with reference to Figures SA and 5B. With regard to FIG. 5A, an example shelf module 510 is shown. The module 510 includes a shelf back 516 that extends between a pair of support surfaces 517-1 and 517-2 (and also above the support surface 517-2). The support surface 517 includes edges 518-1 and 518-2. The support surface 517-2 is shown as supporting a plurality of objects 512, such as products in a retail environment. Although the support surface 517-1 is shown as not directly supporting any object, the shelf back 516 supports a plurality of pins 520, each of which can support additional products 512 above the support surface 517-1. The module 510 includes a plurality of labels, each corresponding to a portion of the products 512. In the illustrated example, the pins 512 carry labels 522, 524, and 526. Additionally, the shelf edge 518-2 carries labels 528, 530, 532, and 534 The data recording device 103 may be arranged {e.g. via instructions issued by the server 101) to cross the module 510 and record a plurality of images from the module 510, Two sample portions of the module 510 recorded by image frames are shown as frames 536 and 540 in FIG. 5A. As can be seen in FIG. 5A overlap the frames 536 and 540, and each portion of the module 510 is therefore shown in more than one frame received by the device 103. The device 103 is also arranged to record depth measurements during the crossing of the module 510. With regard to FIG. 55 shows a point cloud 550 obtained from the above depth measurements. In addition to the point cloud, a shelf face 554 is shown {generated, for example, by the above shelf face detector), as well as shelf edge indicators 558-1 and 558-2, which indicate the detected location of the shelf edges 518-1 and 518-2 in the plane 554. Also shown in FIG. 5B is a plurality of imitation label indicators generally referred to by the number 560 (a more detailed discussion of the label indicators will be provided below). As will be understood, the initial label indicators 560 are greater in number than the physical labels present on the module 510, as shown in FIG. SA. In the present example, the initial label indicators are detected from image data 1s recorded by the device 103. As noted above, the image frames recorded by the device 103 overlap, and therefore typically each of the labels 522 through 534 is detected in more than one image. . All label detections are stored in the memory module 132 and thus each label is represented in the input data obtained at block 405 by a plurality of initial label indicators. As will be appreciated, the label indicators variously include positional errors. Such errors arise from variations in image quality between the above image frames, variations in label detection accuracy, and the like. Additionally, the initial label indicators 560 corresponding to the labels 522, 524 and 526 include additional position errors resulting from their placement on the plane 554 (when the labels 522, 524 and 526 themselves are not at the same depth as the shelf edges 518). The misplacement of such label indicators may result from an assumption made by the label detector, mentioned above, that all labels are in the same plane as the shelf edges 518. Such assumptions may result from the difficulty of accurately detecting true depth of the labels from the depth measurements recorded by the device 103, due to the small size of the labels. In other words, instead of trying to detect a depth for the labels, the label detector can only operate on image data and the two-dimensional positions of detected label in each image frame is transformed to a three-dimensional position in the reference frame 102 by back-projecting the two-dimensional positions on the plane 552. The back projection is based, in the present example, on the stored position of the device 103 at the time of recording each image frame as well as on. Carrying out the rest of the method 400, the server 101 obtains unique label positions for each physical label, which may have greater accuracy than the initial label indicators shown in FIG. 55, With regard to FIG. 6, the input data obtained at block 405 is shown in more detail. In particular, the plane 554 is shown as well as the shelf edge indicators 558-1 and 558-2. The initial label indicators 560 shown in FIG. 55 are also shown in more detail. In particular, initial label indicators 622-1 and 622-2 correspond to the physical label 522 (although that fact is currently unknown to the server 101). Additionally, the label indicators 624-1 and 624-2 correspond to the label 524; the initial label indicators 626-1 and 626-2 correspond to the label 526; lahel indicators 628-1, 628-2 and 628-3 correspond to the label 528; the label indicators 630-1 and 630-2 correspond to the label 530; the label indicators 632-1 and 632-2 correspond to the label 532; and the label indicators 634-1, 634-2 and 634-3 correspond to the label 534. Returning to FIG. 4, at block 410, the server 101, and in particular the candidate subset generator 300, is arranged to add the imitative label indicators. assign to candidate subsets. Each candidate subset corresponds to a single physical label on the shelf module 510. In other words, each candidate subset of initial label indicators includes all detections (from multiple image frames) of a given label shown in FIG. 5A. The assignment of initial label indicators to candidate subsets includes, in some examples, the assignment of each initial label indicator to a candidate subset based on decoded data included in the label indicator. As noted above, any label indicator may include data that has been decoded or otherwise extracted from the portion of the image in which the label was detected. The labels may include barcodes encoding product identifiers, pricing information and the like. Therefore, the assignment of each initial lahel indicator to a candidate subset may include obtaining the decoded data contained in the label indicator (e.g. stored as metadata in association with the coordinates of the label indicator) and assigning the label indicator to a candidate subset corresponding to the decoded data. Thus, each initial label indicator with the same decoded data (e.g., the same product identifier) is assigned to the same candidate subset. However, in some examples, more than one label appears on shelf 510 with the same barcode. In such examples, assigning initial label indicators to candidate subsets based on decoded data can only incorrectly assign indicators corresponding to different labels to the same candidate subset. The server 101 is therefore arranged in some examples to assign the initial label indicators to candidate subsets based on both the above-decoded data and relative positions of the initial label indicators. With regard to FIG. 7, a method 700 for assigning the label indicators to candidate subset is shown (i.e., executing block 410 of the method 400). At block 705 18, the candidate subset generator 300 is configured to determine whether each initial label indicator overlaps with a shelf edge indicator. Initial label indicators for which the determination at block 705 is negative are assigned to candidate subsets at block 710 based on decoded label data as mentioned above. Thus, the label indicators 622, 624 and 626 are shown in FIG. 6 assigned to candidate subsets only based on the decoded data they each include. In the present example, it is assumed that indicators 822 include first decoded data, indicators 624 include second decoded data, and indicators 626 include third decoded data. The above indicators are therefore assigned to three candidate subsets, with indicators 622-1 and 622-2 correspond to the label 522, and so on. Following the generation of the above candidate subsets, the candidate subset generator 300 is arranged to return the subsets for further processing (e.g., by the depth optimizer 304) at block 715. It is evident from FIG. 6 that for the other initial label indicators, the determination at block 705 is affirmative. Therefore, the candidate subset generator 300 proceeds to block 720 for those initial label indicators. At block 720, the generator 300 is arranged to place the initial label indicators in sets based on decoded label data as described above. For the initial label indicators 632 and 634, it is assumed in the present example that they all contain the same decoded data and therefore all become the same set placed. FIG. SA illustrates the set resulting from the execution of block 720. As will be understood, the set shown in FIG. SA not with a single physical label, but with two labels and should therefore be further subdivided. At block 725, the generator 300 determines for each set the average location in the frame 102 (i.e., on the plane 554) of the label indicators in the set. FIG. SA illustrates the average location 800 of the set of label indicators that include indicators 632 and 634. The generator 300 is also arranged to determine the distance from the average 800 to each initial label indicator (e.g., to the center of each label indicator). The above distances are shown as dotted lines in FIG. 8A At block 730 1, the generator 300 is arranged to place the initial label indicators of each set into candidate subsets based on the above distances. For example, the generator 300 may be arranged to group the initial label indicators in the set based on a threshold distance. FIG. 8B illustrates the application of a threshold distance (shown as a circle) to the distances determined in FIG. SA, to divide the set into two candidate subsets 832 and 834 (corresponding to the initial label indicators 632 and 634, respectively). As is evident from FIG. 8B, the distances for each candidate subset 832 and 834 are separated from each other by distances less than the threshold, but an individual member of a subset is separated from a member of the other subset by a distance greater than the threshold. As will now be appreciated, the process set forth in relation to blocks 720 through 730 may not be suitable for label indicators that do not overlap with a shelf edge indicator, as such label indicators may correspond to labels attached to pins 520 or other structures whose actual depth differs substantially from the depth of the plane 554. As a result, the positions of such label indicators on the plane 554 may be too inaccurate to use average locations and distances to assign the label indicators to subsets. Following the execution of block 730, the generator 300 is arranged to repeat the above process for each set generated at block 720 (via block 735). When each set is subdivided into candidate subsets, the candidate subsets are returned for further processing at block 715. It is possible that a candidate subset generated through the execution of blocks 725 and 730 is identical to the set initially generated at block 720. In the case of for example, the initial label indicators 628 (which are assumed to each contain the same decoded data different from the decoded data of other indicators shown in FIG. 6), the above distances may all fall within the threshold, and the initial label indicators 628 are therefore assigned to a single candidate subset. Returning to FIG. 4, at block 415, the depth optimizer is arranged to select a candidate subset for further processing. After a candidate subset is selected, the depth optimizer is arranged to determine an acquired depth for the candidate subset. As noted above, the depth of all initial label indicators is the depth of the shelf face 554. However, the actual labels represented by the initial label indicators are not necessarily at the same depth as the plane 554. As noted previously, the depth of the pin-attached labels 522, 524 and 526 vary significantly with respect to the depth of the shelf edges 518. Furthermore, the plane 554 itself cannot represent an exact fit with the shelf edges 518, and so the depth assigned to the mitial label indicators may not be accurate even for initial label indicators that have labels placed on represent the shelf edges 518. The depth optimizer is arranged to determine an obtained depth for each candidate subset starting at block 420, by generating a plurality of projection sets. Each projection set includes a back-projection of each initial label indicator in the candidate subset to a depth different from the depth of the shelf plane 554, Each projection set 18 generated for a different set of predetermined depths. For example, the series of predetermined depths can start at the depth of the shelf face 554 and increase in increments of | mm until a depth equal to the (previously known or detected from recorded depth measurements) depth of the plank back 516. A variety of other depth increments may also be considered depending on the size of the plank 510, the desired accuracy of the depth obtained and such. With regard to FIG. 9A-9D, the initial label indicators 622-1 and 622-2 (both members of a single candidate subset) are shown in FIG. 9A, FIGS, 9B, 9C and 9D show successive projection sets 900-1 and 900-2, 904-1 and 904-2, and 908-1 and 908-2, Each projection set 900, 904 and 908 is the result of the back - projection of the label indicators 622 to a greater depth than the previous projection set (i.e., the set 908 is at a greater depth than the set 904), Example projection depths relative to the depth of the plane 554 are reported in each of FIGs. 9A-9D. As shown in Figures SA-9D, as projection depth increases, projections of indicators 622-1 and 622-2 begin to overlap. That is, the projections begin to occupy the same three-dimensional space in the frame 102, which is to be expected since both indicators 622 represent the same physical label. Thus, the projection set with the greatest degree of overlap is most likely to correspond to a corrected depth for the indicators 622. The optimizer 304 is therefore arranged to also determine, at block 420, the composite surface area of each projection set (i.e., the total surface area of the projection set}. At block 425, the optimizer 304 is configured to select the projection depth of the projection set with the smallest composite surface area Returning to FIGs, 9A-9D, it is evident that the final projection set (FIG. 8D) has the smallest composite surface area of those shown, therefore optimizer 304 is arranged to select the depth at which projection set 908 was generated. (i.e., 30 cm beyond the depth of the plane 554 in this example). As will now be apparent, a significant number of projection sets may be required to cover a sufficient range of depths to identify an acquired depth that likely reflects the true depth of a given label. For example, when using projection depths with 1 mm increments as mentioned above, three hundred projection sets are required to arrive at the projection set 908 shown in FIG. 9D. Therefore, the optimizer 304 is arranged to use both coarse and fine depth increases in some examples to generate the projection sets. With reference to FIG. 10, a projection depth refinement method 1000 is shown, for execution prior to block 420. In particular, at block 1005, the optimizer 304 is arranged to generate, in some examples, a plurality of coarse projection aggregates and determine the composite surface area of each projection set. The generation of projection sets is as described above in relation to block 420, with the exception that the depth increases separating each projection set are greater than those used at block 420. For example, if an increase of 1 mm is used at block 420, an increase of 2cm are used at block 1005, At block 1010, the optimizer 308 is arranged to select the depth of the coarse projection set having the smallest composite surface area, and at block 1015, the optimizer 304 is configured to determine the range of depths to be used at block 420 according to the coarse depth selected at block 1010, For example, if the selected coarse depth was 24 cm from the plane 554, at block 1015, the optimizer 304 may be arranged to generate a series of projection depths with increments of imm centered on a depth of 24 cm. In some examples, the method 100 can be used for only certain candidate subsets. For example, the optimizer may be configured to perform the method 100 prior to block 420 for label indicators that do not overlap with the shelf edge indicators 568 (i.e., label indicators likely to correspond to pin-attached labels). Returning to FIG. 4, at block 40, the position generator 308 is arranged to generate an obtained position for the candidate subset selected at block 415, based on the obtained depth. For example, the position generator 308 may be configured to generate an acquired position that includes the acquired depth (i.e., along the Z axis of the reference frame 102) as well as the coordinates (e.g., along the X and Y axes of the reference frame 102) of the center of the composite surface area of the projection set selected at block 425. Referring to FIG. 11A, portions of the plane 554 and shelf edge indicator 558-1 are shown together with the label indicators 622, 624, and 626. FIG. 11, meanwhile, shows back projections 1122, 1124 and 1126 corresponding to indicators 622, 624 and 626, respectively. The position of each back projection 1122, 1124 and 1126 includes the depth at which each projection was generated as well as the center of the back projection shown. As is evident from a comparison of FIG. 11B with FIGS. 5A and 5B, the obtained positions of the back projections 1122, 1124 and 1126 correspond more accurately to the positions of the labels 522, 524 and 526 than the initial label indicators 560. Returning to FIG. 4, at block 435, the server 101 determines whether candidate subsets remain to be processed. If the determination at block 435 is affirmative, the execution of blocks 415 through 430 is repeated for each remaining candidate subset. If the determination at block 435 is negative, the execution of method 400 proceeds to block 440, where the obtained positions are generated at block 430, for example, in the memory module 132. For example, the obtained positions can be stored in final label indicators which not only include the obtained positions, but also the decoded data mentioned above and other data extracted from the images recorded by the device 103 (e.g. price information and the like). The final label indicators may include a plurality of decoded data strands, prices, and the like (e.g., one for each initial label indicator from which the final label indicator was generated). Variations of the above systems and methods are contemplated. For example, the depth optimizer 304 is configured in some examples to dynamically determine minimum and maximum depths for which projection sets are generated at block 420. For example, the depth optimizer may be arranged to obtain an expected actual size for a label based on the decoded data. The depth optimizer may further be arranged to determine an estimated depth error based on the size and size of the initial label indicator obtained (for example, the two sizes may indicate that the depth of the imitative label indicator is likely about 20 cm above or below the actual depth of the label). The depths used at block 420 (or via the method 1000) can be determined to cross the depth thus determined. Specific embodiments have been described in the foregoing description. It is noted, however, that various modifications and changes can be made without departing from the scope of the invention as set out in the claims below. Accordingly, the description and figures are to be considered in an illustrative rather than a limiting sense, and all such adaptations are intended to be included within the scope of the present teachings. The benefits, solutions to problems, and any element that could lead to any benefit, or solution that occurs or becomes more pronounced, should not be interpreted as a critical, necessary, or essential measure or element of any or all of the claims. The invention is defined only by the appended claims including modifications made while the pending of this application and all equivalents of those granted claims. For the purpose of clarity and a brief description, features herein are described as part of the same or separate embodiments. It is to be noted, however, that the scope of the invention may include embodiments that have combinations of all or some of the features described herein. It may be assumed that the embodiments shown include like or equivalent components, except where described as otherwise. In addition, in this document, relative terms such as first and second, top and bottom, and the like can only be used to distinguish one entity or action from another entity or action without necessarily necessitating any of these factual relationships or orders between such entities or actions is or is implied. The terms "includes", "comprising", "has", "having", "contains", "containing" or any other variation thereof, are intended to cover a non-exclusive inclusion such that a process, method, article , or device that includes a list of elements includes not only those elements, but may also include other elements not expressly stated or inherent in such a process, method, article, or device. An element preceded by “includes… a”, “has… a”, “contains… a” does not, without limitation, exclude the existence of additional identical elements in the process, the method, the article, or the device that element includes, has, contains. The term "one" is defined as one or more, unless expressly stated otherwise herein. The terms "substantially", "essential", "about", or any other version thereof, are defined as being close by, as understood by one skilled in the art, and in one non-limiting embodiment, the term is defined to be within 10%, in another embodiment to be within 5%, in another embodiment to be within 1%, and in another embodiment to be within 0.5%. The term "linked" as used herein is defined as connected, although not necessarily direct and not necessarily mechanical. Their device or structure that is "configured" in some way is configured in at least that way, but it can also be configured in ways not indicated. It is noted that some embodiments may include one or more generic or specialized processors (or "processing devices"), such as microprocessors, digital signal processors, customized processors, and field programmable gate arrays (FFGAs) and uniquely stored program instructions (including both software and hardware) that control the one or more processors, to implement some, most, or all functions in combination with certain non-processor circuits of the method and / or device described herein. Alternatively, some or all of the functions could be implemented by a state machine that has no stored program instructions, or in one or more application-specific integrated circuits (ASICs), in which each function or some combinations of certain functions are implemented as custom logic (on custom made). Obviously, a combination of the two approaches could be used. In addition, an embodiment can be implemented as a computer readable storage medium having stored thereon a computer readable code for programming a computer (e.g., including a processor) to perform a method as described and claimed herein. Examples of such computer readable storage media include, but are not limited to, a hard disk, a CD-ROM, an optical storage device, a magnetic storage device, a ROM (read-only memory), a PROM (programmable read-only memory ), an EPROM (erasable programmable read-only memory), an EEPROM (electrically erasable programmable read-only memory) and a flash memory. It is further noted that despite potentially significant effort and many design choices motivated by, for example, available time, current technology, and economic considerations, when guided by the concepts and principles described herein, one will be easily able to generate such software instructions and programs and ÌCs with minimal experimentation. The summary of the description is provided to enable the reader to quickly understand the nature of the technical description. It is submitted on the assumption that it will not be used to interpret the claims or to limit the scope of protection thereof. in the foregoing extended description, several measures have been grouped together in various embodiments for the purpose of streamlining the description. This method of description is not to be interpreted as reflecting an intention that the embodiments claimed require more measures than are expressly enumerated in each claim. Instead, as the following claims express, the subject matter of the invention lies in less than all of the features of a single described embodiment. So the following conclusions have been incorporated into the detailed description, with each conclusion standing on its own as separate claimed matter. The mere fact that certain measures are mentioned in mutually different claims does not indicate that a combination of these measures cannot be used for an advantage. A large number of variants will be clear to the skilled person. All variants are considered to be included within the scope of the invention as defined in the following claims.
权利要求:
Claims (18) [1] A method of obtaining label positions in an image controller, the method comprising: receiving () a definition of a plane that includes edges of a support structure, and (1) a plurality of initial label indicators having locations on the plane; assigning the initial label indicators to candidate subsets from a plurality of candidate subsets of label indicators, each candidate subset representing a single physical label; for each candidate subset of initial label indicators: generating, for each of a plurality of projection depths relative to the plane, a set of projections of the initial label indicators in the candidate subset; selecting, as an acquired depth for the candidate subset, one of the projection depths based on the sets of projections; and generating an obtained position for the candidate subset based on the obtained depth; and storing the obtained positions. [2] The method of claim 1, wherein each imitation label indicator includes decoded data; and wherein assigning the initial label indicators to candidate subsets from a plurality of candidate subsets comprises assigning each initial label indicator to one of the candidate subsets based on the decoded data, [3] The method of claim 2, further comprising receiving an edge indicator that defines a location of an edge of the support structure in the plane; wherein assigning the initial label indicators to candidate subsets from a plurality of candidate subsets further comprises: for initial label indicators that do not overlap with the edge indicator, assigning each initial label indicator to one of the candidate subsets based on the decoded data. [4] The method of claim 3, wherein the edge indicator is a shelf edge indicator. [5] The method of claim a or 4, wherein assigning the initial label indicators to candidate subsets from a plurality of candidate subsets further comprises, for initial label indicators overlapping with the edge indicator: assigning the initial label indicators to one of a multiple number of collections based on the decoded data; determining an average position of the initial label indicators within each set; and assigning the initial label indicators within each set to the candidate subset based on a distance from each of the initial label indicators to the average position. [6] The method of any of the preceding claims, further comprising 235 determining a composite surface area for each set of projections; and selecting, as the obtained depth, the projection depth corresponding to a minimum composite surface area. [7] The method of any of the preceding claims, further comprising, prior to generating the sets of projections: generating, for each of a plurality of coarse projection depths relative to the plane, a set of coarse projections of the initial label indicators in the candidate subset; selecting one of the coarse projection depths; and generating the plurality of projection depths based on the selected coarse projection depth. [8] The method of claim 7, wherein generating the plurality of projection depths includes adding a predetermined increment to the selected coarse projection depth. [9] The method of any of the preceding claims, wherein the support structure is one of a shelf and a table. [10] A known device for obtaining label positions, comprising: a memory; and an image controller connected to the memory, the image controller being arranged to: (1) receive a definition of a plane comprising edges of a support structure, and (11) receive a plurality of initial label indicators having locations on the plane; assign the initial label indicators to candidate subsets from a plurality of candidate subsets of label indicators, each candidate subset representing a single physical label; for each candidate subset of initial label indicators: for each of a multiple number of projection depths relative to the plane, generate a set of projections of the initial label indicators in the candidate subset; if an acquired depth for the candidate subset, select one of the projection depths based on the sets of projections; and generate an acquired position for the candidate subset based on the acquisition depth; and the image controller is further arranged to store the obtained positions in the memory, [11] The calculator of claim 10, wherein each initial label indicator includes decoded data; and wherein the image controller is further arranged to assign the initial label indicators to candidate subsets from a plurality of candidate subsets by assigning each initial label indicator to one of the candidate subsets based on the decoded data. [12] The computing apparatus of claim 11, wherein the image controller is further adapted to: receive an edge indicator defining an edge location of the support structure in the plane; assigning the initial label indicators to candidate subsets from a plurality of candidate subsets further by: for initial label indicators that do not overlap with the edge indicator, assigning each initial label indicator to one of the candidate subsets based on the decoded data. [13] The calculator of claim 12, wherein the edge indicator is a shelf edge indicator. [14] The computing apparatus of claim 12 or 13, wherein the image controller is further adapted to assign the initial label indicators to candidate subsets from a plurality of number candidate subsets by, for initial label indicators overlapping the edge indicator: assign the initial label indicators to one of a plurality of sets based on the decoded data; determining an average position of the imitative label indicators within each set; and assigning the initial label indicators within each set to the candidate subset based on a distance from each of the initial label indicators to the average position. [15] The computing device of any one of claims 10-14, wherein the image controller is further adapted to: determine a composite surface area for each set of projections; and as the obtained depth, select the projection depth corresponding to a minimum composite surface area, [16] Calculator according to any of claims 10-15, wherein the image controller is further arranged, prior to generating the projection sets: for each of a plurality of coarse projection depths relative to the plane, to generate a set of coarse projections of the imitative label indicators in the candidate subset; select one of the coarse projection depths; and wherein the image controller is further arranged to generate the multiple number of projection depths based on the selected coarse projection depth. [17] The known device of claim 16, wherein the image controller is further adapted to generate the plurality of projection depths by adding a predetermined increment to the selected coarse projection depth. [18] Calculator according to any of claims 10-17, wherein the support structure is one of a shelf and a table.
类似技术:
公开号 | 公开日 | 专利标题 BE1026160B1|2020-07-15|METHOD AND CALCULATOR FOR OBTAINING LABEL POSITIONS BE1025892B1|2019-09-12|METHOD FOR SCREEN EDGE DETECTION US20180314908A1|2018-11-01|Method and apparatus for label detection AU2018220103B2|2020-03-05|Method and apparatus for support surface edge detection US20180315065A1|2018-11-01|Method and apparatus for extracting and processing price text from an image set US9424482B2|2016-08-23|Method and apparatus for image processing to avoid counting shelf edge promotional labels when counting product labels BE1026149B1|2020-07-03|METHOD, SYSTEM AND APPARATUS FOR CORRECTING TRANSPARENCY ARTEFACTS IN DATA REPRESENTING A SUPPORT STRUCTURE US10521914B2|2019-12-31|Multi-sensor object recognition system and method US20160063519A1|2016-03-03|Data analysis apparatus, data analysis system, commodity exchange forecasting apparatus, commodity exchange forecasting system, data analysis method, commodity exchange forecasting method, and computer-readable medium BE1026161A9|2019-10-29|METHOD, SYSTEM AND DEVICE FOR MOBILE AUTOMATION DEVICE LOCALIZATION US20210272316A1|2021-09-02|Method, System and Apparatus for Object Detection in Point Clouds US11100303B2|2021-08-24|Method, system and apparatus for auxiliary label detection and association BE1027283B1|2021-02-25|METHOD, SYSTEM AND DEVICE FOR DETECTING PRODUCT VIEWS US11080566B2|2021-08-03|Method, system and apparatus for gap detection in support structures with peg regions US20220020170A1|2022-01-20|Mixed depth object detection JP2019057326A|2019-04-11|Pos terminal device US11107238B2|2021-08-31|Method, system and apparatus for detecting item facings CN210573826U|2020-05-19|Intelligent commodity identification equipment and intelligent settlement table US20200183408A1|2020-06-11|Method and apparatus for navigational ray tracing JP2022512604A|2022-02-07|Methods, systems and equipment for determining the depth of the support structure WO2018201423A1|2018-11-08|Method and apparatus for detecting and interpreting price label text JP5818281B2|2015-11-18|Distance detection device, reader provided with distance detection device, distance detection method, and distance detection program WO2020247067A1|2020-12-10|Method, system and apparatus for shelf edge detection CN113269053A|2021-08-17|Commodity shelf-level acquisition method, terminal and storage device
同族专利:
公开号 | 公开日 US10832436B2|2020-11-10| US20190311489A1|2019-10-10| BE1026160A1|2019-10-22| WO2019195588A1|2019-10-10|
引用文献:
公开号 | 申请日 | 公开日 | 申请人 | 专利标题 US20040184655A1|2003-03-19|2004-09-23|Remo Ziegler|Three-dimensional scene reconstruction from labeled two-dimensional images| US20160171429A1|2014-12-10|2016-06-16|Ricoh Co., Ltd.|Realogram Scene Analysis of Images: Shelf and Label Finding| US20170286773A1|2016-03-29|2017-10-05|Bossa Nova Robotics Ip, Inc.|Planogram Assisted Inventory System and Method| GB223238A|1924-06-03|1925-12-03|Albert Paul Streit|Improvements in or relating to turnbuckles or strainers for wire and other tension members| US5214615A|1990-02-26|1993-05-25|Will Bauer|Three-dimensional displacement of a body with computer interface| US5209712A|1991-06-24|1993-05-11|Frederic Ferri|Proprioceptive exercise, training and therapy apparatus| US5199084A|1991-08-16|1993-03-30|International Business Machines Corporation|Apparatus and method for locating characters on a label| US5408322A|1993-04-26|1995-04-18|Materials Research Corporation|Self aligning in-situ ellipsometer and method of using for process monitoring| JP3311830B2|1993-09-20|2002-08-05|株式会社東芝|3D video creation device| KR100197676B1|1993-09-27|1999-06-15|윤종용|Robot cleaner| WO1995015533A1|1993-11-30|1995-06-08|Burke Raymond R|Computer system for allowing a consumer to purchase packaged goods at home| US5414268A|1994-02-01|1995-05-09|The Coe Manufacturing Company|Light scanner with interlaced camera fields and parallel light beams| US20020014533A1|1995-12-18|2002-02-07|Xiaxun Zhu|Automated object dimensioning system employing contour tracing, vertice detection, and forner point detection and reduction methods on 2-d range data maps| JPH0996672A|1995-09-29|1997-04-08|Sukuuea:Kk|Method and system for generating three-dimensional positional data| US6034379A|1996-03-01|2000-03-07|Intermec Ip Corp.|Code reader having replaceable optics assemblies supporting multiple illuminators| US5831719A|1996-04-12|1998-11-03|Holometrics, Inc.|Laser scanning system| US5988862A|1996-04-24|1999-11-23|Cyra Technologies, Inc.|Integrated system for quickly and accurately imaging and modeling three dimensional objects| US6075905A|1996-07-17|2000-06-13|Sarnoff Corporation|Method and apparatus for mosaic image construction| US5953055A|1996-08-08|1999-09-14|Ncr Corporation|System and method for detecting and analyzing a queue| US6026376A|1997-04-15|2000-02-15|Kenney; John A.|Interactive electronic shopping system and method| GB2330265A|1997-10-10|1999-04-14|Harlequin Group Limited The|Image compositing using camera data| IL122079A|1997-10-30|2002-02-10|Netmor Ltd|Ultrasonic positioning and tracking system| WO1999023600A1|1997-11-04|1999-05-14|The Trustees Of Columbia University In The City Of New York|Video signal face region detection| US6975764B1|1997-11-26|2005-12-13|Cognex Technology And Investment Corporation|Fast high-accuracy multi-dimensional pattern inspection| US7016539B1|1998-07-13|2006-03-21|Cognex Corporation|Method for fast, robust, multi-dimensional pattern recognition| US6332098B2|1998-08-07|2001-12-18|Fedex Corporation|Methods for shipping freight| US6820895B2|1998-09-23|2004-11-23|Vehicle Safety Systems, Inc.|Vehicle air bag minimum distance enforcement apparatus, method and system| US6442507B1|1998-12-29|2002-08-27|Wireless Communications, Inc.|System for creating a computer model and measurement database of a wireless communication network| US6711293B1|1999-03-08|2004-03-23|The University Of British Columbia|Method and apparatus for identifying scale invariant features in an image and use of same for locating an object in an image| US6388688B1|1999-04-06|2002-05-14|Vergics Corporation|Graph-based visual navigation through spatial environments| US6850946B1|1999-05-26|2005-02-01|Wireless Valley Communications, Inc.|Method and system for a building database manipulator| US6711283B1|2000-05-03|2004-03-23|Aperio Technologies, Inc.|Fully automatic rapid microscope slide scanner| WO2002005121A2|2000-07-11|2002-01-17|Mediaflow, Llc|System and method for calculating an optimum display size for a visual object| GB0020850D0|2000-08-23|2000-10-11|Univ London|A system and method for intelligent modelling of public spaces| TW512478B|2000-09-14|2002-12-01|Olympus Optical Co|Alignment apparatus| US7054509B2|2000-10-21|2006-05-30|Cardiff Software, Inc.|Determining form identification through the spatial relationship of input data| US20040021313A1|2000-11-21|2004-02-05|Gardner Michael Stuart|Tag marking| US7068852B2|2001-01-23|2006-06-27|Zoran Corporation|Edge detection and sharpening process for an image| JP2002321698A|2001-04-27|2002-11-05|Mitsubishi Heavy Ind Ltd|Boarding bridge for carrying air cargo| US7277187B2|2001-06-29|2007-10-02|Quantronix, Inc.|Overhead dimensioning system and method| US7046273B2|2001-07-02|2006-05-16|Fuji Photo Film Co., Ltd|System and method for collecting image information| US6995762B1|2001-09-13|2006-02-07|Symbol Technologies, Inc.|Measurement of dimensions of solid objects from two-dimensional image| WO2003025805A1|2001-09-18|2003-03-27|Pro-Corp Holdings International Limited|Image recognition inventory management system| US6722568B2|2001-11-20|2004-04-20|Ncr Corporation|Methods and apparatus for detection and processing of supplemental bar code labels| US7233699B2|2002-03-18|2007-06-19|National Instruments Corporation|Pattern matching using multiple techniques| US20060106742A1|2002-04-29|2006-05-18|Speed Trac Technologies, Inc.|System and method for weighing and tracking freight| US7149749B2|2002-06-03|2006-12-12|International Business Machines Corporation|Method of inserting and deleting leaves in tree table structures| US6928194B2|2002-09-19|2005-08-09|M7 Visual Intelligence, Lp|System for mosaicing digital ortho-images| EP1434170A3|2002-11-07|2006-04-05|Matsushita Electric Industrial Co., Ltd.|Method and apparatus for adding ornaments to an image of a person| JP3862652B2|2002-12-10|2006-12-27|キヤノン株式会社|Printing control method and information processing apparatus| US7248754B2|2003-05-05|2007-07-24|International Business Machines Corporation|Apparatus and method for determining whether machine readable information on an item matches the item| US7137207B2|2003-06-23|2006-11-21|Armstrong Timothy D|Measuring arrangement to determine location of corners for a building foundation and a wooden base frame, and the use thereof| US7090135B2|2003-07-07|2006-08-15|Symbol Technologies, Inc.|Imaging arrangement and barcode imager for imaging an optical code or target at a plurality of focal planes| US7493336B2|2003-07-22|2009-02-17|International Business Machines Corporation|System and method of updating planogram information using RFID tags and personal shopping device| DE10336638A1|2003-07-25|2005-02-10|Robert Bosch Gmbh|Apparatus for classifying at least one object in a vehicle environment| TWI266035B|2003-11-11|2006-11-11|Hon Hai Prec Ind Co Ltd|A system and method for measuring point-cloud| SE0400556D0|2004-03-05|2004-03-05|Pricer Ab|Electronic shelf labeling system, electronic label, handheld device and method in an electronic labeling system| DE112005000738T5|2004-03-29|2007-04-26|Evolution Robotics, Inc., Pasadena|Method and device for determining position using reflected light sources| US20050213109A1|2004-03-29|2005-09-29|Evolution Robotics, Inc.|Sensing device and method for measuring position and orientation relative to multiple light sources| US9534899B2|2005-03-25|2017-01-03|Irobot Corporation|Re-localization of a robot for slam| US7885865B2|2004-05-11|2011-02-08|The Kroger Co.|System and method for mapping of planograms| US7245558B2|2004-06-18|2007-07-17|Symbol Technologies, Inc.|System and method for detection using ultrasonic waves| US7168618B2|2004-08-12|2007-01-30|International Business Machines Corporation|Retail store method and system| US7643665B2|2004-08-31|2010-01-05|Semiconductor Insights Inc.|Method of design analysis of existing integrated circuits| US7845560B2|2004-12-14|2010-12-07|Sky-Trax Incorporated|Method and apparatus for determining position and rotational orientation of an object| US7783383B2|2004-12-22|2010-08-24|Intelligent Hospital Systems Ltd.|Automated pharmacy admixture system | WO2006136958A2|2005-01-25|2006-12-28|Dspv, Ltd.|System and method of improving the legibility and applicability of document pictures using form based image enhancement| US7440903B2|2005-01-28|2008-10-21|Target Brands, Inc.|System and method for evaluating and recommending planograms| DE102005007536A1|2005-02-17|2007-01-04|Isra Vision Systems Ag|Method for calibrating a measuring system| US7751928B1|2005-03-11|2010-07-06|Amazon Technologies, Inc.|Method and system for agent exchange-based materials handling| EP1872264A4|2005-04-13|2010-07-07|Store Eyes Inc|Method and system for automatically measuring retail store display compliance| US20100171826A1|2006-04-12|2010-07-08|Store Eyes, Inc.|Method for measuring retail display and compliance| US20080175513A1|2005-04-19|2008-07-24|Ming-Jun Lai|Image Edge Detection Systems and Methods| US8294809B2|2005-05-10|2012-10-23|Advanced Scientific Concepts, Inc.|Dimensioning system| US7590053B2|2005-06-21|2009-09-15|Alcatel Lucent|Multiple endpoint protection using SPVCs| US9829308B2|2005-06-28|2017-11-28|Outotec Pty Ltd|System and method for measuring and mapping a surface relative to a reference| US7817826B2|2005-08-12|2010-10-19|Intelitrac Inc.|Apparatus and method for partial component facial recognition| WO2007030026A1|2005-09-09|2007-03-15|Industrial Research Limited|A 3d scene scanner and a position and orientation system| EP1934936A2|2005-10-10|2008-06-25|Nordic Bioscience A/S|A method of segmenting an image| US7605817B2|2005-11-09|2009-10-20|3M Innovative Properties Company|Determining camera motion| US7508794B2|2005-11-29|2009-03-24|Cisco Technology, Inc.|Authorizing an endpoint node for a communication service| US8577538B2|2006-07-14|2013-11-05|Irobot Corporation|Method and system for controlling a remote vehicle| JP4730121B2|2006-02-07|2011-07-20|ソニー株式会社|Image processing apparatus and method, recording medium, and program| US20070197895A1|2006-02-17|2007-08-23|Sdgi Holdings, Inc.|Surgical instrument to assess tissue characteristics| US8157205B2|2006-03-04|2012-04-17|Mcwhirk Bruce Kimberly|Multibody aircrane| CA2737302C|2006-04-28|2013-06-18|Global Sensor Systems Inc.|Device for measuring package size| AT470912T|2006-04-28|2010-06-15|Toyota Motor Europ Nv|ROBUST DETECTOR AND DESCRIPTOR FOR ONE POINT OF INTEREST| US20070272732A1|2006-05-26|2007-11-29|Mettler-Toledo, Inc.|Weighing and dimensioning system and method for weighing and dimensioning| EP2041516A2|2006-06-22|2009-04-01|Roy Sandberg|Method and apparatus for robotic path planning, selection, and visualization| JP4910507B2|2006-06-29|2012-04-04|コニカミノルタホールディングス株式会社|Face authentication system and face authentication method| US7647752B2|2006-07-12|2010-01-19|Greg Magnell|System and method for making custom boxes for objects of random size or shape| US7940955B2|2006-07-26|2011-05-10|Delphi Technologies, Inc.|Vision-based method of determining cargo status by boundary detection| US7693757B2|2006-09-21|2010-04-06|International Business Machines Corporation|System and method for performing inventory using a mobile inventory robot| WO2008052349A1|2006-11-02|2008-05-08|Queen's University At Kingston|Method and apparatus for assessing proprioceptive function| WO2008057504A2|2006-11-06|2008-05-15|Aman James A|Load tracking system based on self- tracking forklift| US8531457B2|2006-11-29|2013-09-10|Technion Research And Development Foundation Ltd.|Apparatus and method for finding visible points in a cloud point| US7474389B2|2006-12-19|2009-01-06|Dean Greenberg|Cargo dimensional and weight analyzing system| US8189926B2|2006-12-30|2012-05-29|Videomining Corporation|Method and system for automatically analyzing categories in a physical space based on the visual characterization of people| US20080164310A1|2007-01-09|2008-07-10|Dupuy Charles G|Labeling system| JP4878644B2|2007-03-15|2012-02-15|学校法人関西大学|Moving object noise removal processing apparatus and moving object noise removal processing program| DE102007013807B4|2007-03-22|2014-11-13|Siemens Aktiengesellschaft|Method for assisting the navigation of interventional tools when performing CT- and MRI-guided interventions at a given intervention level| US7940279B2|2007-03-27|2011-05-10|Utah State University|System and method for rendering of texel imagery| US8132728B2|2007-04-04|2012-03-13|Sick, Inc.|Parcel dimensioning measurement system and method| US8094937B2|2007-04-17|2012-01-10|Avago Technologies Ecbu Ip Pte. Ltd.|System and method for labeling feature clusters in frames of image data for optical navigation| JP4561769B2|2007-04-27|2010-10-13|アイシン・エィ・ダブリュ株式会社|Route guidance system and route guidance method| US8229781B2|2007-04-27|2012-07-24|The Nielson Company , Llc|Systems and apparatus to determine shopper traffic in retail environments| RU2009148504A|2007-06-08|2011-07-20|Теле Атлас Б.В. |METHOD AND DEVICE FOR CREATING A PANORAMA WITH MULTIPLE SURVEILLANCE POINTS| WO2008154611A2|2007-06-11|2008-12-18|Honeywell International Inc.|Optical reader system for extracting information in a digital image| US7982423B2|2007-07-04|2011-07-19|Bossa Nova Concepts, Llc|Statically stable biped robotic mechanism and method of actuating| JP4661838B2|2007-07-18|2011-03-30|トヨタ自動車株式会社|Route planning apparatus and method, cost evaluation apparatus, and moving body| KR100922494B1|2007-07-19|2009-10-20|삼성전자주식회사|Method for measuring pose of a mobile robot and method and apparatus for measuring position of the mobile robot using the method| US7726575B2|2007-08-10|2010-06-01|Hand Held Products, Inc.|Indicia reading terminal having spatial measurement functionality| US8950673B2|2007-08-30|2015-02-10|Symbol Technologies, Inc.|Imaging system for reading target with multiple symbols| US8009864B2|2007-08-31|2011-08-30|Accenture Global Services Limited|Determination of inventory conditions based on image processing| US9135491B2|2007-08-31|2015-09-15|Accenture Global Services Limited|Digital point-of-sale analyzer| US7949568B2|2007-08-31|2011-05-24|Accenture Global Services Limited|Determination of product display parameters based on image processing| US8189855B2|2007-08-31|2012-05-29|Accenture Global Services Limited|Planogram extraction based on image processing| US8630924B2|2007-08-31|2014-01-14|Accenture Global Services Limited|Detection of stock out conditions based on image processing| US8295590B2|2007-09-14|2012-10-23|Abbyy Software Ltd.|Method and system for creating a form template for a form| JP4466705B2|2007-09-21|2010-05-26|ヤマハ株式会社|Navigation device| US8396284B2|2007-10-23|2013-03-12|Leica Geosystems Ag|Smart picking in 3D point clouds| US8091782B2|2007-11-08|2012-01-10|International Business Machines Corporation|Using cameras to monitor actual inventory| US20090125350A1|2007-11-14|2009-05-14|Pieter Lessing|System and method for capturing and storing supply chain and logistics support information in a relational database system| US20090160975A1|2007-12-19|2009-06-25|Ncr Corporation|Methods and Apparatus for Improved Image Processing to Provide Retroactive Image Focusing and Improved Depth of Field in Retail Imaging Systems| US8423431B1|2007-12-20|2013-04-16|Amazon Technologies, Inc.|Light emission guidance| US20090192921A1|2008-01-24|2009-07-30|Michael Alan Hicks|Methods and apparatus to survey a retail environment| US8353457B2|2008-02-12|2013-01-15|Datalogic ADC, Inc.|Systems and methods for forming a composite image of multiple portions of an object from multiple perspectives| US8207964B1|2008-02-22|2012-06-26|Meadow William D|Methods and apparatus for generating three-dimensional image data models| US7971664B2|2008-03-18|2011-07-05|Bossa Nova Robotics Ip, Inc.|Efficient actuation and selective engaging and locking clutch mechanisms for reconfiguration and multiple-behavior locomotion of an at least two-appendage robot| US9766074B2|2008-03-28|2017-09-19|Regents Of The University Of Minnesota|Vision-aided inertial navigation| US8064729B2|2008-04-03|2011-11-22|Seiko Epson Corporation|Image skew detection apparatus and methods| US20150170256A1|2008-06-05|2015-06-18|Aisle411, Inc.|Systems and Methods for Presenting Information Associated With a Three-Dimensional Location on a Two-Dimensional Display| JP4720859B2|2008-07-09|2011-07-13|カシオ計算機株式会社|Image processing apparatus, image processing method, and program| US8184196B2|2008-08-05|2012-05-22|Qualcomm Incorporated|System and method to generate depth data using edge detection| US9841314B2|2008-08-29|2017-12-12|United Parcel Service Of America, Inc.|Systems and methods for freight tracking and monitoring| US9824495B2|2008-09-11|2017-11-21|Apple Inc.|Method and system for compositing an augmented reality scene| US20100070365A1|2008-09-12|2010-03-18|At&T Intellectual Property I, L.P.|Planogram guided shopping| US8636201B2|2008-09-14|2014-01-28|Eliezer Magal|Automatic identification system for randomly oriented objects| US20100091094A1|2008-10-14|2010-04-15|Marek Sekowski|Mechanism for Directing a Three-Dimensional Camera System| AU2009307654A1|2008-10-20|2010-04-29|Raritan Americas, Inc.|System and method for automatic determination of the physical location of data center equipment| US8479996B2|2008-11-07|2013-07-09|Symbol Technologies, Inc.|Identification of non-barcoded products| KR101234798B1|2008-11-24|2013-02-20|삼성전자주식회사|Method and apparatus for measuring position of the mobile robot| US8463079B2|2008-12-16|2013-06-11|Intermec Ip Corp.|Method and apparatus for geometrical measurement using an optical device such as a barcode and/or RFID scanner| US8812226B2|2009-01-26|2014-08-19|GM Global Technology Operations LLC|Multiobject fusion module for collision preparation system| US8265895B2|2009-03-27|2012-09-11|Symbol Technologies, Inc.|Interactive sensor systems and methods for dimensioning| US8284988B2|2009-05-13|2012-10-09|Applied Vision Corporation|System and method for dimensioning objects using stereoscopic imaging| US8743176B2|2009-05-20|2014-06-03|Advanced Scientific Concepts, Inc.|3-dimensional hybrid camera and production system| US8049621B1|2009-05-28|2011-11-01|Walgreen Co.|Method and apparatus for remote merchandise planogram auditing and reporting| US8542252B2|2009-05-29|2013-09-24|Microsoft Corporation|Target digitization, extraction, and tracking| US8933925B2|2009-06-15|2015-01-13|Microsoft Corporation|Piecewise planar reconstruction of three-dimensional scenes| US7997430B2|2009-06-30|2011-08-16|Target Brands, Inc.|Display apparatus and method| US20120019393A1|2009-07-31|2012-01-26|Robert Wolinsky|System and method for tracking carts in a retail environment| CA2754159C|2009-08-11|2012-05-15|Certusview Technologies, Llc|Systems and methods for complex event processing of vehicle-related information| AR077903A1|2009-08-21|2011-09-28|Syngenta Participations Ag|AUTOMATED PHENOTIPIC CLASSIFICATION OF SOYBEAN FOR CHLORINE DAMAGE| KR101619076B1|2009-08-25|2016-05-10|삼성전자 주식회사|Method of detecting and tracking moving object for mobile platform| US8942884B2|2010-01-14|2015-01-27|Innovative Transport Solutions, Llc|Transport system| US20130278631A1|2010-02-28|2013-10-24|Osterhout Group, Inc.|3d positioning of augmented reality information| US20110216063A1|2010-03-08|2011-09-08|Celartem, Inc.|Lidar triangular network compression| US8456518B2|2010-03-31|2013-06-04|James Cameron & Vincent Pace|Stereoscopic camera with automatic obstruction removal| US8570343B2|2010-04-20|2013-10-29|Dassault Systemes|Automatic generation of 3D models from packaged goods product images| US8199977B2|2010-05-07|2012-06-12|Honeywell International Inc.|System and method for extraction of features from a 3-D point cloud| US9109877B2|2010-05-21|2015-08-18|Jonathan S. Thierman|Method and apparatus for dimensional measurement| US8134717B2|2010-05-21|2012-03-13|LTS Scale Company|Dimensional detection system and associated method| US20110310088A1|2010-06-17|2011-12-22|Microsoft Corporation|Personalized navigation through virtual 3d environments| US20120022913A1|2010-07-20|2012-01-26|Target Brands, Inc.|Planogram Generation for Peg and Shelf Items| JP4914528B1|2010-08-31|2012-04-11|新日鉄ソリューションズ株式会社|Augmented reality providing system, information processing terminal, information processing apparatus, augmented reality providing method, information processing method, and program| CN103221975B|2010-09-03|2017-04-19|加州理工学院|Three-dimensional imaging system| US9002099B2|2011-09-11|2015-04-07|Apple Inc.|Learning-based estimation of hand and finger pose| US8872851B2|2010-09-24|2014-10-28|Intel Corporation|Augmenting image data based on related 3D point cloud data| EP2439487B1|2010-10-06|2012-08-22|Sick Ag|Volume measuring device for mobile objects| US8174931B2|2010-10-08|2012-05-08|HJ Laboratories, LLC|Apparatus and method for providing indoor location, position, or tracking of a mobile computer using building information| US9171442B2|2010-11-19|2015-10-27|Tyco Fire & Security Gmbh|Item identification using video recognition to supplement bar code or RFID information| US20120133639A1|2010-11-30|2012-05-31|Microsoft Corporation|Strip panorama| US8867793B2|2010-12-01|2014-10-21|The Trustees Of The University Of Pennsylvania|Scene analysis using image and range data| US9317761B2|2010-12-09|2016-04-19|Nanyang Technological University|Method and an apparatus for determining vein patterns from a colour image| US8773946B2|2010-12-30|2014-07-08|Honeywell International Inc.|Portable housings for generation of building maps| US8744644B2|2011-01-19|2014-06-03|Electronics And Telecommunications Research Institute|Apparatus and method for detecting location of vehicle| KR101758058B1|2011-01-20|2017-07-17|삼성전자주식회사|Apparatus and method for estimating camera motion using depth information, augmented reality system| CN103443802B|2011-01-24|2016-12-14|数据逻辑Adc公司|For reading the system and method for optical code| US20120190453A1|2011-01-25|2012-07-26|Bossa Nova Robotics Ip, Inc.|System and method for online-offline interactive experience| US20120191880A1|2011-01-26|2012-07-26|Bossa Nova Robotics IP, Inc|System and method for identifying accessories connected to apparatus| JP5905031B2|2011-01-28|2016-04-20|インタッチ テクノロジーズ インコーポレイテッド|Interfacing with mobile telepresence robot| WO2012100593A1|2011-01-30|2012-08-02|浙江省电力公司|Fully-automatic verification system for intelligent electric energy meters| US8711206B2|2011-01-31|2014-04-29|Microsoft Corporation|Mobile camera localization using depth maps| US8447549B2|2011-02-11|2013-05-21|Quality Vision International, Inc.|Tolerance evaluation with reduced measured points| US8619265B2|2011-03-14|2013-12-31|Faro Technologies, Inc.|Automatic measurement of dimensional data with a laser tracker| US8660338B2|2011-03-22|2014-02-25|Honeywell International Inc.|Wide baseline feature matching using collobrative navigation and digital terrain elevation data constraints| JPWO2012132324A1|2011-03-31|2014-07-24|日本電気株式会社|Store system, control method thereof, control program, and information access system| US8693725B2|2011-04-19|2014-04-08|International Business Machines Corporation|Reliability in detecting rail crossing events| US9854209B2|2011-04-19|2017-12-26|Ford Global Technologies, Llc|Display system utilizing vehicle and trailer dynamics| CA2835830A1|2011-05-11|2012-11-15|Proiam, Llc|Enrollment apparatus, system, and method featuring three dimensional camera| US20120287249A1|2011-05-12|2012-11-15|Electronics And Telecommunications Research Institute|Method for obtaining depth information and apparatus using the same| US8902353B2|2011-05-12|2014-12-02|Symbol Technologies, Inc.|Imaging reader with independently controlled illumination rate| US9785898B2|2011-06-20|2017-10-10|Hi-Tech Solutions Ltd.|System and method for identifying retail products and determining retail product arrangements| US9064394B1|2011-06-22|2015-06-23|Alarm.Com Incorporated|Virtual sensors| US9070285B1|2011-07-25|2015-06-30|UtopiaCompression Corporation|Passive camera based cloud detection and avoidance for aircraft systems| US8768620B2|2011-07-27|2014-07-01|Msa Technology, Llc|Navigational deployment and initialization systems and methods| KR101907081B1|2011-08-22|2018-10-11|삼성전자주식회사|Method for separating object in three dimension point clouds| US9129277B2|2011-08-30|2015-09-08|Digimarc Corporation|Methods and arrangements for identifying objects| US9367770B2|2011-08-30|2016-06-14|Digimarc Corporation|Methods and arrangements for identifying objects| TWI622540B|2011-09-09|2018-05-01|辛波提克有限責任公司|Automated storage and retrieval system| US9033239B2|2011-11-11|2015-05-19|James T. Winkel|Projected image planogram system| US9159047B2|2011-11-11|2015-10-13|James T. Winkel|Projected image planogram system| US8726200B2|2011-11-23|2014-05-13|Taiwan Semiconductor Manufacturing Co., Ltd.|Recognition of template patterns with mask information| US8706293B2|2011-11-29|2014-04-22|Cereson Co., Ltd.|Vending machine with automated detection of product position| US9635606B2|2012-11-04|2017-04-25|Kt Corporation|Access point selection and management| US8793107B2|2011-12-01|2014-07-29|Harris Corporation|Accuracy-based significant point derivation from dense 3D point clouds for terrain modeling| CN103164842A|2011-12-14|2013-06-19|鸿富锦精密工业(深圳)有限公司|Point cloud extraction system and method| US20130154802A1|2011-12-19|2013-06-20|Symbol Technologies, Inc.|Method and apparatus for updating a central plan for an area based on a location of a plurality of radio frequency identification readers| US20130162806A1|2011-12-23|2013-06-27|Mitutoyo Corporation|Enhanced edge focus tool| AU2013207414B2|2012-01-06|2016-02-11|Sunrise R&D Holdings, Llc|Display shelf modules with projectors for displaying product information and modular shelving systems comprising the same| EP2615580B1|2012-01-13|2016-08-17|Softkinetic Software|Automatic scene calibration| US9740937B2|2012-01-17|2017-08-22|Avigilon Fortress Corporation|System and method for monitoring a retail environment using video content analysis with depth sensing| US9037287B1|2012-02-17|2015-05-19|National Presort, Inc.|System and method for optimizing a mail document sorting machine| US8958911B2|2012-02-29|2015-02-17|Irobot Corporation|Mobile robot| ES2535122T3|2012-03-01|2015-05-05|Caljan Rite-Hite Aps|Extensible conveyor with light| US8668136B2|2012-03-01|2014-03-11|Trimble Navigation Limited|Method and system for RFID-assisted imaging| US9329269B2|2012-03-15|2016-05-03|GM Global Technology Operations LLC|Method for registration of range images from multiple LiDARS| US8989342B2|2012-04-18|2015-03-24|The Boeing Company|Methods and systems for volumetric reconstruction using radiography| US9153061B2|2012-05-04|2015-10-06|Qualcomm Incorporated|Segmentation of 3D point clouds for dense 3D modeling| US9525976B2|2012-05-10|2016-12-20|Honeywell International Inc.|BIM-aware location based application| WO2013170260A1|2012-05-11|2013-11-14|Proiam, Llc|Hand held dimension capture apparatus, system, and method| US8941645B2|2012-05-11|2015-01-27|Dassault Systemes|Comparing virtual and real images in a shopping experience| US9846960B2|2012-05-31|2017-12-19|Microsoft Technology Licensing, Llc|Automated camera array calibration| US10203762B2|2014-03-11|2019-02-12|Magic Leap, Inc.|Methods and systems for creating virtual and augmented reality| US9135543B2|2012-06-20|2015-09-15|Apple Inc.|Compression and obfuscation of three-dimensional coding| US9420265B2|2012-06-29|2016-08-16|Mitsubishi Electric Research Laboratories, Inc.|Tracking poses of 3D camera using points and planes| US20140003655A1|2012-06-29|2014-01-02|Praveen Gopalakrishnan|Method, apparatus and system for providing image data to represent inventory| US9418352B2|2012-06-29|2016-08-16|Intel Corporation|Image-augmented inventory management and wayfinding| US8971637B1|2012-07-16|2015-03-03|Matrox Electronic Systems Ltd.|Method and system for identifying an edge in an image| KR101441187B1|2012-07-19|2014-09-18|고려대학교 산학협력단|Method for planning path for a humanoid robot| EP2877959B1|2012-07-24|2018-04-18|Datalogic USA, Inc.|Systems and methods of object measurement in an automated data reader| US8757479B2|2012-07-31|2014-06-24|Xerox Corporation|Method and system for creating personalized packaging| ES2545374T3|2012-07-31|2015-09-10|Sick Ag|Detection system for mounting on a conveyor belt| US20140047342A1|2012-08-07|2014-02-13|Advanced Micro Devices, Inc.|System and method for allocating a cluster of nodes for a cloud computing system based on hardware characteristics| US8923893B2|2012-08-07|2014-12-30|Symbol Technologies, Inc.|Real-time planogram generation and maintenance| US11074495B2|2013-02-28|2021-07-27|Z Advanced Computing, Inc. |System and method for extremely efficient image and pattern recognition and artificial intelligence platform| CN103679164A|2012-09-21|2014-03-26|阿里巴巴集团控股有限公司|A method and a system for identifying and processing a mark based on a mobile terminal| US9939259B2|2012-10-04|2018-04-10|Hand Held Products, Inc.|Measuring object dimensions using mobile computer| US9472022B2|2012-10-05|2016-10-18|University Of Southern California|Three-dimensional point processing and model generation| US20140192050A1|2012-10-05|2014-07-10|University Of Southern California|Three-dimensional point processing and model generation| FR2996512B1|2012-10-05|2014-11-21|Renault Sa|METHOD FOR EVALUATING THE RISK OF COLLISION AT AN INTERSECTION| US9841311B2|2012-10-16|2017-12-12|Hand Held Products, Inc.|Dimensioning system| WO2014066422A2|2012-10-22|2014-05-01|Bossa Nova Robotics Ip, Inc.|Self-deploying support member, and methods and apparatus using same| JPWO2014068784A1|2012-11-05|2016-09-08|三菱電機株式会社|3D imaging system and particle beam therapy system| US9562971B2|2012-11-22|2017-02-07|Geosim Systems Ltd.|Point-cloud fusion| US8825258B2|2012-11-30|2014-09-02|Google Inc.|Engaging and disengaging for autonomous driving| US9380222B2|2012-12-04|2016-06-28|Symbol Technologies, Llc|Transmission of images for inventory monitoring| US10701149B2|2012-12-13|2020-06-30|Level 3 Communications, Llc|Content delivery framework having origin services| WO2014092552A2|2012-12-13|2014-06-19|Mimos Berhad|Method for non-static foreground feature extraction and classification| US20140195373A1|2013-01-10|2014-07-10|International Business Machines Corporation|Systems and methods for managing inventory in a shopping store| US20140214547A1|2013-01-25|2014-07-31|R4 Technologies, Llc|Systems and methods for augmented retail reality| US9154773B2|2013-03-15|2015-10-06|Seiko Epson Corporation|2D/3D localization and pose estimation of harness cables using a configurable structure representation for robot operations| TWI594933B|2013-03-15|2017-08-11|辛波提克有限責任公司|Automated storage and retrieval system| US8965561B2|2013-03-15|2015-02-24|Cybernet Systems Corporation|Automated warehousing using robotic forklifts| US9558559B2|2013-04-05|2017-01-31|Nokia Technologies Oy|Method and apparatus for determining camera location information and/or camera pose information according to a global coordinate system| WO2014181323A1|2013-05-05|2014-11-13|Trax Technology Solutions Pte Ltd.|System and method of retail image analysis| EP3006272A4|2013-05-29|2016-06-15|Toyota Motor Co Ltd|Parking assistance device| US9158988B2|2013-06-12|2015-10-13|Symbol Technclogies, LLC|Method for detecting a plurality of instances of an object| US10268983B2|2013-06-26|2019-04-23|Amazon Technologies, Inc.|Detecting item interaction and movement| US9443297B2|2013-07-10|2016-09-13|Cognex Corporation|System and method for selective determination of point clouds| US10290031B2|2013-07-24|2019-05-14|Gregorio Reid|Method and system for automated retail checkout using context recognition| US9473747B2|2013-07-25|2016-10-18|Ncr Corporation|Whole store scanner| US10349031B2|2013-07-28|2019-07-09|Michael J. DeLuca|Augmented reality based user interfacing| US20150088618A1|2013-08-26|2015-03-26|Ims Solutions, Inc.|Road tolling| US9886678B2|2013-09-25|2018-02-06|Sap Se|Graphic representations of planograms| US9615012B2|2013-09-30|2017-04-04|Google Inc.|Using a second camera to adjust settings of first camera| US9248611B2|2013-10-07|2016-02-02|David A. Divine|3-D printed packaging| US20150106403A1|2013-10-15|2015-04-16|Indooratlas Oy|Generating search database based on sensor measurements| US9412040B2|2013-12-04|2016-08-09|Mitsubishi Electric Research Laboratories, Inc.|Method for extracting planes from 3D point cloud sensor data| US9349076B1|2013-12-20|2016-05-24|Amazon Technologies, Inc.|Template-based target object detection in an image| US9565400B1|2013-12-20|2017-02-07|Amazon Technologies, Inc.|Automatic imaging device selection for video analytics| EP3108686B1|2014-02-21|2019-06-19|Telefonaktiebolaget LM Ericsson |Wlan throughput prediction| MY177646A|2014-02-28|2020-09-23|Icm Airport Technics Australia Pty Ltd|Luggage processing station and system thereof| US20150262116A1|2014-03-16|2015-09-17|International Business Machines Corporation|Machine vision technology for shelf inventory management| US9953420B2|2014-03-25|2018-04-24|Ford Global Technologies, Llc|Camera calibration| CN103945208B|2014-04-24|2015-10-28|西安交通大学|A kind of parallel synchronous zooming engine for multiple views bore hole 3D display and method| EP3152010A4|2014-06-04|2018-01-24|Intelligrated Headquarters LLC|Truck unloader visualization| CN104023249B|2014-06-12|2015-10-21|腾讯科技(深圳)有限公司|Television channel recognition methods and device| US9542746B2|2014-06-13|2017-01-10|Xerox Corporation|Method and system for spatial characterization of an imaging system| US9659204B2|2014-06-13|2017-05-23|Conduent Business Services, Llc|Image processing methods and systems for barcode and/or product label recognition| US10176452B2|2014-06-13|2019-01-08|Conduent Business Services Llc|Store shelf imaging system and method| US10453046B2|2014-06-13|2019-10-22|Conduent Business Services, Llc|Store shelf imaging system| KR20170024072A|2014-06-27|2017-03-06|크라운 이큅먼트 코포레이션|Vehicle positioning or navigation utilizing associated feature pairs| US11051000B2|2014-07-14|2021-06-29|Mitsubishi Electric Research Laboratories, Inc.|Method for calibrating cameras with non-overlapping views| DE102014011821A1|2014-08-08|2016-02-11|Cargometer Gmbh|Device and method for determining the volume of an object moved by an industrial truck| US20160044862A1|2014-08-14|2016-02-18|Raven Industries, Inc.|Site specific product application device and method| CN104200086B|2014-08-25|2017-02-22|西北工业大学|Wide-baseline visible light camera pose estimation method| US20160061591A1|2014-08-28|2016-03-03|Lts Metrology, Llc|Stationary Dimensioning Apparatus| JP2016057108A|2014-09-08|2016-04-21|株式会社トプコン|Arithmetic device, arithmetic system, arithmetic method and program| US10365110B2|2014-09-30|2019-07-30|Nec Corporation|Method and system for determining a path of an object for moving from a starting state to an end state set avoiding one or more obstacles| US10296950B2|2014-09-30|2019-05-21|Apple Inc.|Beacon triggered processes| US9576194B2|2014-10-13|2017-02-21|Klink Technologies|Method and system for identity and age verification| US9706105B2|2014-10-20|2017-07-11|Symbol Technologies, Llc|Apparatus and method for specifying and aiming cameras at shelves| US9796093B2|2014-10-24|2017-10-24|Fellow, Inc.|Customer service robot and related systems and methods| US9600892B2|2014-11-06|2017-03-21|Symbol Technologies, Llc|Non-parametric method of and system for estimating dimensions of objects of arbitrary shape| JP5946073B2|2014-11-07|2016-07-05|インターナショナル・ビジネス・マシーンズ・コーポレーションInternational Business Machines Corporation|Estimation method, estimation system, computer system, and program| US10022867B2|2014-11-11|2018-07-17|X Development Llc|Dynamically maintaining a map of a fleet of robotic devices in an environment to facilitate robotic action| EP3221851A1|2014-11-20|2017-09-27|Cappasity Inc.|Systems and methods for 3d capture of objects using multiple range cameras and multiple rgb cameras| US10248653B2|2014-11-25|2019-04-02|Lionbridge Technologies, Inc.|Information technology platform for language translation and task management| US9396554B2|2014-12-05|2016-07-19|Symbol Technologies, Llc|Apparatus for and method of estimating dimensions of an object associated with a code in automatic response to reading the code| US9928708B2|2014-12-12|2018-03-27|Hawxeye, Inc.|Real-time video analysis for security surveillance| US9628695B2|2014-12-29|2017-04-18|Intel Corporation|Method and system of lens shift correction for a camera array| US20160253735A1|2014-12-30|2016-09-01|Shelfscreen, Llc|Closed-Loop Dynamic Content Display System Utilizing Shopper Proximity and Shopper Context Generated in Response to Wireless Data Triggers| US9367831B1|2015-03-16|2016-06-14|The Nielsen Company , Llc|Methods and apparatus for inventory determinations using portable devices| US9877012B2|2015-04-01|2018-01-23|Canon Kabushiki Kaisha|Image processing apparatus for estimating three-dimensional position of object and method therefor| US9600731B2|2015-04-08|2017-03-21|Toshiba Tec Kabushiki Kaisha|Image processing apparatus, image processing method and computer-readable storage medium| US9868443B2|2015-04-27|2018-01-16|GM Global Technology Operations LLC|Reactive path planning for autonomous driving| CA2986698A1|2015-05-26|2016-12-01|Crown Equipment Corporation|Systems and methods for image capture device calibration for a materials handling vehicle| US9646410B2|2015-06-30|2017-05-09|Microsoft Technology Licensing, Llc|Mixed three dimensional scene reconstruction from plural surface models| US20170011308A1|2015-07-09|2017-01-12|SunView Software, Inc.|Methods and Systems for Applying Machine Learning to Automatically Solve Problems| US10410096B2|2015-07-09|2019-09-10|Qualcomm Incorporated|Context-based priors for object detection in images| CN107852453B|2015-07-10|2020-06-23|深圳市大疆创新科技有限公司|Dual lens system with beam splitter| US9549125B1|2015-09-01|2017-01-17|Amazon Technologies, Inc.|Focus specification and focus stabilization| GB2542115B|2015-09-03|2017-11-15|Rail Vision Europe Ltd|Rail track asset survey system| MX2018002739A|2015-09-04|2018-08-01|Crown Equip Corp|Industrial vehicle with feature-based localization and navigation.| US9684081B2|2015-09-16|2017-06-20|Here Global B.V.|Method and apparatus for providing a location data error map| EP3154008B1|2015-10-09|2017-12-20|Pricer AB|Determination of a product position along a fixture| US9517767B1|2015-11-04|2016-12-13|Zoox, Inc.|Internal safety systems for robotic vehicles| WO2017201490A1|2016-05-19|2017-11-23|Simbe Robotics Inc.|Method for automatically generating a planogram that assigns products to shelving structures within a store| US10607182B2|2015-11-09|2020-03-31|Simbe Robotics, Inc.|Method for tracking stock level within a store| US20170150129A1|2015-11-23|2017-05-25|Chicago Measurement, L.L.C.|Dimensioning Apparatus and Method| US10336543B1|2016-01-21|2019-07-02|Wing Aviation Llc|Selective encoding of packages| US10352689B2|2016-01-28|2019-07-16|Symbol Technologies, Llc|Methods and systems for high precision locationing with depth values| US10145955B2|2016-02-04|2018-12-04|Symbol Technologies, Llc|Methods and systems for processing point-cloud data with a line scanner| US10768305B2|2016-02-05|2020-09-08|Samsung Electronics Co., Ltd.|Vehicle and method of recognizing position of vehicle based on map| US10197400B2|2016-02-25|2019-02-05|Sharp Laboratories Of America, Inc.|Calibration methods and systems for an autonomous navigation vehicle| US10229386B2|2016-03-03|2019-03-12|Ebay Inc.|Product tags, systems, and methods for crowdsourcing and electronic article surveillance in retail inventory management| US20170261993A1|2016-03-10|2017-09-14|Xerox Corporation|Systems and methods for robot motion control and improved positional accuracy| US9928438B2|2016-03-10|2018-03-27|Conduent Business Services, Llc|High accuracy localization system and method for retail store profiling via product image recognition and its corresponding dimension database| US10721451B2|2016-03-23|2020-07-21|Symbol Technologies, Llc|Arrangement for, and method of, loading freight into a shipping container| US9805240B1|2016-04-18|2017-10-31|Symbol Technologies, Llc|Barcode scanning and dimensioning| US9791862B1|2016-04-25|2017-10-17|Thayermahan, Inc.|Systems and method for unmanned undersea sensor position, orientation, and depth keeping| US10339595B2|2016-05-09|2019-07-02|Grabango Co.|System and method for computer vision driven applications within an environment| US9639935B1|2016-05-25|2017-05-02|Gopro, Inc.|Apparatus and methods for camera alignment model calibration| US10394244B2|2016-05-26|2019-08-27|Korea University Research And Business Foundation|Method for controlling mobile robot based on Bayesian network learning| CN109328359A|2016-06-30|2019-02-12|波萨诺瓦机器人知识产权有限公司|Multi-camera system for inventory tracking| US10785418B2|2016-07-12|2020-09-22|Bossa Nova Robotics Ip, Inc.|Glare reduction method and system| WO2018018007A1|2016-07-22|2018-01-25|Focal Systems, Inc.|Determining in-store location based on images| US9827683B1|2016-07-28|2017-11-28|X Development Llc|Collaborative inventory monitoring| US10054447B2|2016-08-17|2018-08-21|Sharp Laboratories Of America, Inc.|Lazier graph-based path planning for autonomous navigation| US20180053091A1|2016-08-17|2018-02-22|Hawxeye, Inc.|System and method for model compression of neural networks for use in embedded platforms| US10776661B2|2016-08-19|2020-09-15|Symbol Technologies, Llc|Methods, systems and apparatus for segmenting and dimensioning objects| US20180101813A1|2016-10-12|2018-04-12|Bossa Nova Robotics Ip, Inc.|Method and System for Product Data Review| US10210603B2|2016-10-17|2019-02-19|Conduent Business Services Llc|Store shelf imaging system and method| US10289990B2|2016-10-17|2019-05-14|Conduent Business Services, Llc|Store shelf imaging system and method| US10019803B2|2016-10-17|2018-07-10|Conduent Business Services, Llc|Store shelf imaging system and method using a vertical LIDAR| US20180114183A1|2016-10-25|2018-04-26|Wal-Mart Stores, Inc.|Stock Level Determination| US10451405B2|2016-11-22|2019-10-22|Symbol Technologies, Llc|Dimensioning system for, and method of, dimensioning freight in motion along an unconstrained path in a venue| US10354411B2|2016-12-20|2019-07-16|Symbol Technologies, Llc|Methods, systems and apparatus for segmenting objects| US9778388B1|2016-12-22|2017-10-03|Thayermahan, Inc.|Systems and methods for autonomous towing of an underwater sensor array| US10121072B1|2016-12-30|2018-11-06|Intuit Inc.|Unsupervised removal of text from form images| US10293485B2|2017-03-30|2019-05-21|Brain Corporation|Systems and methods for robotic path planning| US10229322B2|2017-04-06|2019-03-12|Ants Technology Limited|Apparatus, methods and computer products for video analytics| US10726273B2|2017-05-01|2020-07-28|Symbol Technologies, Llc|Method and apparatus for shelf feature and object placement detection from shelf images| US10663590B2|2017-05-01|2020-05-26|Symbol Technologies, Llc|Device and method for merging lidar data| US10505057B2|2017-05-01|2019-12-10|Symbol Technologies, Llc|Device and method for operating cameras and light sources wherein parasitic reflections from a paired light source are not reflected into the paired camera| US20180314908A1|2017-05-01|2018-11-01|Symbol Technologies, Llc|Method and apparatus for label detection| US10591918B2|2017-05-01|2020-03-17|Symbol Technologies, Llc|Fixed segmented lattice planning for a mobile automation apparatus| US20180315065A1|2017-05-01|2018-11-01|Symbol Technologies, Llc|Method and apparatus for extracting and processing price text from an image set| US10949798B2|2017-05-01|2021-03-16|Symbol Technologies, Llc|Multimodal localization and mapping for a mobile automation apparatus| CN107067382A|2017-05-11|2017-08-18|南宁市正祥科技有限公司|A kind of improved method for detecting image edge| US20190034864A1|2017-07-25|2019-01-31|Bossa Nova Robotics Ip, Inc.|Data Reduction in a Bar Code Reading Robot Shelf Monitoring System| US10127438B1|2017-08-07|2018-11-13|Standard Cognition, Corp|Predicting inventory events using semantic diffing| US10861302B2|2017-08-17|2020-12-08|Bossa Nova Robotics Ip, Inc.|Robust motion filtering for real-time video surveillance| US10783379B2|2017-08-23|2020-09-22|Bossa Nova Robotics Ip, Inc.|Method for new package detection| US10572763B2|2017-09-07|2020-02-25|Symbol Technologies, Llc|Method and apparatus for support surface edge detection| US20190180150A1|2017-12-13|2019-06-13|Bossa Nova Robotics Ip, Inc.|Color Haar Classifier for Retail Shelf Label Detection| JP2019114126A|2017-12-25|2019-07-11|富士通株式会社|Object recognition device, object recognition method, and object recognition program|US10558761B2|2018-07-05|2020-02-11|Disney Enterprises, Inc.|Alignment of video and textual sequences for metadata analysis| EP3832526A1|2019-12-04|2021-06-09|Pricer AB|Positioning and identification of electronic labels using a camera| EP3832527A1|2019-12-04|2021-06-09|Pricer AB|Controlling output of electronic labels from camera|
法律状态:
2020-08-26| FG| Patent granted|Effective date: 20200715 |
优先权:
[返回顶部]
申请号 | 申请日 | 专利标题 US15/945,926|US10832436B2|2018-04-05|2018-04-05|Method, system and apparatus for recovering label positions| 相关专利
Sulfonates, polymers, resist compositions and patterning process
Washing machine
Washing machine
Device for fixture finishing and tension adjusting of membrane
Structure for Equipping Band in a Plane Cathode Ray Tube
Process for preparation of 7 alpha-carboxyl 9, 11-epoxy steroids and intermediates useful therein an
国家/地区
|